Spherical homogeneous spaces of minimal rank 

N. Ressayre 

Abstract. Let G be a complex connected reductive algebraic group and G/B denote the 
flag variety of G. A G-homogeneous space G/H is said to be spherical if H has a finite 
number of orbits in G/B. A class of spherical homogeneous spaces containing the tori, the 
complete homogeneous spaces and the group G (viewed as a G x G-homogeneous space) has 
G^'' particularly nice proterties. Namely, the pair {G,H) is called a spherical pair of minimal 
O , rank if there exists x in G/B such that the orbit H.x of a; by if is open in G/B and the 

^ ' stabilizer of x in if contains a maximal torus of H. In this article, we study and classify 
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the spherical pairs of minimal rank. 
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m ; 1 Introduction 

^ ! Let G be a complex connected reductive algebraic group. Let B denote the flag variety 

^ I of G. Let H be an algebraic subgroup of G which has a finite number of orbits in B ; the 

subgroup H and the homogeneous space G/H are said to be spherical. 

In this article, we study and classify a class of spherical homogeneous spaces containing 

the tori, the complete homogeneous spaces and the group G viewed as a G x G-homogeneous 

space. Namely, the pair (G, H) is called a spherical pair of minimal rank if there exists x in 

B such that the orbit H.x of a; by if is open in B and the stabilizer H^ of x in if contains 

>• I a maximal torus of H. In |Kno95j the rank ik{G/H) of the homogeneous space G/H is 

defined. Moreover, we have rk(G/ii) > rk(G) — rk(ii) (where rk(G) and rk(ii) denotes the 

\C> • ranks of the groups G and H) with equality if and only if (G, H) is of minimal rank. This 
O 



explains the name. The spherical pairs (G, H) of minimal rank such that ii is a symmetric 
subgroup of G firstly appear in |Bri04j . During the redaction of this article the compactifica- 
Q\ ' tions of the spherical homogeneous spaces of minimal rank was studied in |Tch05] and |BJ06j . 

o ■ 

Let us state our main result. Propositions 13. ![ 13.21 and 14.21 reduce the classification to 
^ . the special case when G is semi-simple adjoint and H is simple. Indeed, any spherical pair 
of minimal rank is obtained from special ones and toric ones by products, finite covers and 
parabolic inductions. Next, we prove 

Theorem A The spherical pairs (G, H) of minimal rank with G semi-simple adjoint and 
H simple are: 

(i) G = H. 

(ii) H is simple and diagonally embedded in G = H x H . 
(Hi) (PSL2„, PSp2„) with n>2. 
(iv) (PSOan, S02„-i) with n>A. 
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(v) {SO,,G^). 

(vi) iEe,F,). 

We denote by H(i3) the set of the if-orbit closures in B. If if = P is a Borel subgroup of 
G, the elements of H(i3) are the famous Schubert varieties. Most of combinatorial and geo- 
metric properties of the Schubert varieties cannot be generalized to the elements of H.{G/B) 
if H is only spherical. However, if H is of minimal rank the elements of H.{G/B) have nice 
properties. Let us give details. 

The Weyl group W of G acts transitively on the set of Schubert varieties; this action 
parametrizes these varieties by W/Wp. In general, F. Knop has defined in |Kno95] an action 
of W in H(i3); but, it seems to be difficult to deduce a parametrization of H(i3) from this 
action. We show in Proposition 12. II that G/H is of minimal rank if and only if the action of 
W is transitive on H(i3). In this case, the isotropy groups are isomorphic to the Weyl group 
Wh of H] and, W/Wh parametrizes H(i3). 

The Schubert varieties are normal; but, in general elements of H(i3) are not normal 
(see [BriOlj or |Pin01j for examples). By a result of Brion, if G/if is of minimal rank, the 
elements of H(S) are normal. 

In |Kno95] . F. Knop also defined an action of a monoid W (constructed from the gener- 
ators of W) on H(i3). Moreover, the inclusion defines an order on which generalizes 
the Bruhat order for the Schubert varieties. The description of the Bruhat order from the 
action of W is well known as the cancellation lemma. In general, no such description of this 
order is known. Corollary 12.11 is a cancellation lemma in the minimal rank case. 

The number of Schubert varieties of dimension d equal those of the codimension d. In 
Proposition 12.31 we show such a symmetry property of H(i3) for any spherical pair {G, H) of 
minimal rank. 

Let us explain another important motivation for this work. Let T be a maximal torus of 
G and X be a G-equivariant embedding of a spherical homogeneous space G/H of minimal 
rank. In Proposition 12.41 we show that for all fixed point x of T in X, G.x is complete. This 
property seems to play a key role in several works about the embeddings of G x G/G (see 
for example, |Tch02j ). 

In Section[21 we study the properties of H(i3) and of the toroidal embeddings of G/H for 
the spherical pairs {G, H) of minimal rank. This allows us to give several characterizations 
of the minimal rank property. In Section [3l we reduce the classification to the case when 
G and H are semisimple. In Section IH we classify such pairs by associating to {G, H) an 
involution on the vertices of the Dynkin diagram of G. 

2 Equivalent definitions and first properties 

2.1 Minimal rank and orbits oi H m. B 

2.1.1 — Let us fix some general notation. If X is a variety, dim(X) denotes the dimension 



2 



of X. It X belongs to X, T^X denotes the Zariski-tangent space of X at x. If T is an algebraic 
group a T-variety X is a variety endowed with an algebraic action of F. Let F be an affine 
algebraic group and X be a F-variety. For x a point in X, we denote by F^. the isotropy 
group of X and by T.x its orbit. We denote by X^ the set of fixed point of F in X. We 
denote by F" the unipotent radical of F. 

2.1.2 — Let us recall that G is a connected complex reductive group, B its flag variety, 
H a spherical subgroup of G and H(i3) the set of the iJ-orbit closures in B. If V belongs to 
H(i3), we denote by V° the unique open if-orbit in V. 

We recall the definition of |Res04] of a graph T{G/H) whose vertices are the elements of 
H(i3). The original construction of T{G/ H) due to M. Brion is equivalent but very slightly 
different (see |Bri01] ). 

Consider the set A of conjugacy classes of minimal non solvable parabolic subgroups of 
G. If a belongs to A, we denote by Va the G-homogeneous space with isotropy a. Then, 
there exists a unique G-equivariant map 0^ : B — Va which is a P^-bundle. 

Let V G H(i3) and a e A. We assume that the restriction of 0^ to V° is finite and we 
denote its degree by d{y,a). Then, 0a^(0a(^)) is an element denoted V of H(S); in this 
case, we say that a raises V to V. One of the three following cases occurs. 

• Type U: H has two orbits in <f)a\<Pa{V°)) {V° and V'°) and d{V,a) = 1. 

• Type T: H has three orbits in (f)~^ {(j)a{V°)) and d{V,a) = 1. 

• Type N: H has two orbits in (p^^MVl) and V'°) and d{V,a) = 2. 

Definition. Let T{G/H) be the oriented graph with vertices the elements of H(i3) and 
edges labeled by A, where V is joined to V by an edge labeled by a if a raises V to V . 
This edge is simple (resp. double) if diV^a) = 1 (resp. 2). Following the above cases, we 
say that an edge has type U, T or N. 

2.1.3 — Let us fix a Borel subgroup B of G. Let y be a S-variety. The character group 
A'(y) of Y is the set of all characters of B that arise as weights of eigenvectors of B in the 
function field K(y). Then X{Y) is a free abelian group of finite rank rk(y), the rank ofY 
(see |Kno95] ). It is well known that a i?-orbit O is isomorphic as a variety to x (K*Y 
where r = rk((9) and / = dim((9) — rk((9). 

If V belongs to H(i3), we set: 

Vh = {gH/H : g-'B/B e V}. 

Then, Vh is a i?-orbit closure in G/H. Moreover, the map V i — > Vh is a bijection from 
H(i3) onto the set of the 5-orbit closures in G/H. The rank of Vh is also denoted by rk(l^) 
and called the rank of V. 

2.1.4 — Let T be a maximal torus of B. Let W denote the Weyl group of T. Every 
a in A has a unique representative Pa which contains B. Moreover, there exists a unique 
Sa in W such that BsaB is dense in Pq,; and this Sa is a simple reflexion of W . The map, 
A — > W, a I — > Sa is a bijection from A onto the set of simple reflexions of W. 
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F. Knop defined in |Kno95j an action of W on tlie set H(i3) by describing tlie action of 
the Sa, for any a G A: 

• Type U: Sa exchanges the two vertices of an edge of type U labeled by a. 

• Type T: If a raises Vi and V2 to V, then SaVi = V2 and SaV = V. 

• Type A^: Sa fixes the two vertices of a double edge labeled by a. 

• Sa fixes all others vertices of T{G/H). 

2.1.5 — We can now characterize the spherical pairs of minimal rank in terms of H(i3): 
Proposition 2.1 With above notation, the following are equivalent: 

(i) There exists x G i3 such that H.x is open in B and contains a maximal torus of H. 
(11) rk(G') - rk(if) = i\i{G/H). 
(Hi) All the elements ofii{B) have same rank. 

(iv) All the edges in T{G/H) have type U. 

(v) W acts transitively on T{G/ H). 

If {G, H) satisfies these properties, we say that {G, H) is of minimal rank. 

Proof. The equivalence between the two first assertions follows from |Res05t Corollary 3.1]. 

Let us recall some properties of the graph T{G/H) from |Bri01] . If a raises V to V by 
an edge of type U (resp. T or A^) then ik{y') = rk(\^) (resp. Tk{V') = rk(V^) + 1). Moreover, 
all V in H(i3) is joined to B by an increasing path in V{G/ H) (property of connectedness). 
Finally, the rank of a closed //-orbit in B equals rk(G') — ik{H). 



Now, one easily checks the equivalence between Assertions (ii) , (iii) , (iv) and (v) □ 

2.1.6 — Let (G, H) be a spherical pair of minimal rank. Then, the elements of H(,B) can 
be parametrized. Indeed, let Wq be the stabilizer of B for the action of W . In jResOS] . it is 
shown that Wq is isomorphic to the Weyl group Wh of H. Moreover, Proposition 12.11 shows 
that the Knop's action gives a bijection between W/Wq and H(0). In particular, we have: 
|H(i3)| = yl^, where \E\ denotes the cardinality of the finite set E. 

Each orbit closure of if in i3 is multiplicity- free in the sense of |Bri01] . In particular, 
by |Bri01l Theorem 5] V is normal. 

2.1.7 — In this paragraph, we are interested in reading the generalized Bruhat order off 
the graph T{G/H). Let us start by showing the following nice property of this graph: 

Proposition 2.2 There exists a unique closed orbit of H in B and it is the only minimal 
element ofT{G/H). 
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Proof. Let Vq be a closed orbit of H in B. Let Hq be the set of the if-orbit closures in B 
linked with Vq by an oriented path in T{G/H). It is sufficient to prove that Hq = H(i3). 

We assume that H(i3) — Hq is not empty. Since B belongs to Hq and all the orbits are 
joined to B by an oriented path, there exists Z G H(i3) — Hq and a G A such that a raises 
Z to an element Z' of Hq (it is sufficient to take Z of maximal dimension in H(i3) — Hq). 
Let us fix such a pair (Z, a) such that Z is of minimal dimension. 

Since Z' ^ Vq, there exists /5 G A and Y G Hq such that (3 raises Y to Z' . Since the 
edges of V{G/ H) are of type U and F 7^ Z, we have {3 ^ a. 

Using [Brio 11 Lemma 3], one easily checks that one of the two following graphs is a 
subgraph olV{G/H): 




(3 Y 




In the first case, Z, V and V" does not belong to Hq. By minimality of the dimension of 
Z and by considering (V", (3) we deduce that V does not belong to Hq. Now, the pair (V, a) 
contradicts the minimality of the dimension of Z. A similar argue works in the second case. □ 

Let V in H(i3) and Vq denote the unique closed if -orbit B. By Proposition 12.21 there 
exists an increasing path in V{G/ H) from Vq to V . Let (ai, ■ ■ ■ , as) be the sequence of the 
labels of the edges of such a path. Notice that s = dim(^) — dim(Vo). The inclusion relation 
ii{B) can be read off the graph T{G/H) by the following cancellation corollary: 

Corollary 2.1 We use above notation and fix V in H(S). Set k = dim{V') — dim(Vo). 
Then, V G V if and only if there exists ii < ■ ■ ■ < i^ such that the increasing path starting 
from Vo and with labels (a^^, ■ ■ ■ , aj^.) ends at V . 

Proof. Using Proposition 12. 2^ the proof of [RS90j works here. □ 

2.1.8 — Let do (resp. du) denote the dimension of the complete flag variety of G (resp. 
H). Then, we have the following "symmetry" on the set H(;B): 

Proposition 2.3 Here we assume that H is connected. For allO < 6 < dc — dH, the number 
of elements in ii{B) of dimension do — S equal those of dimension du + 5. 

Proof. Consider Pg(^) and Pnit) the Poincare polynomials of the complete flag varieties 
of G and H. By Poincare duality, they are symmetric polynomials of degrees do and dn ', 
that is, f^^Pail/t) = Pcit) and t'^«Pff(l/t) = Pnit). 
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Consider the following polynomial: 



We claim that Q{t).PH{t) — -Pg(^)- The claim imphes that Q{t) is symmetric and so the 

proposition. 

Let Bh denote the flag variety of H. For any x E B, is a. solvable subgroup of H 
containing a maximal torus of H. It follows that is contained in a Borel subgroup of H: 
consider ip^ '■ H.x — > Bh the map induced by this inclusion. Moreover, the fiber ip~^{ipx{x)) 
is isomorphic to an affine space of dimension dim(iJ.a;) — du- 

We choose one point in each orbit oi H in B and consider the associated morphisms ip^- 
There exists a flnitely generated extension of Q such that G, H, the inclusion of H in 
G, the chosen points in B, the morphisms ipx-, the isomorphisms between the fibers the 
and affine spaces are all defined. By taking an extension if necessary, we may (and shall) 
also assume that the Schubert cells (for fixed Borel subgroups of G and H) of B and Bh are 
defined and isomorphic to affine spaces over K. 

Now, we consider a finite quotient of K and the points B{¥qn) of B over F^n for all 
positive integer n. By using the decompositions of B and Bh in Schubert cells, one obtain: 

|B(F,n)| = PG(g") and |B^^(F,n)| = Pj,(g-). 

Now, we count the points in B(¥qn) by using the decomposition in if-orbits: 

\B{¥,.)\= l^°(V)l= E l^/^(F,n)|.(g"f°^(^)-''-=P/f(g'^).g(g'^). 

VeH(B) VeH(B) 

The claim follows. □ 



2.2 Minimal rank and toroidal embeddings 

2.2.1 — In this subsection, {G,H) is a spherical pair not necessarily of minimal rank. 

An embedding of G/H is a pair (X, x) where X is a normal and irreducible G- variety and x 
is a point of X such that G.x is open in X and Gx = H . Such an embedding is said to be 
toroidal if any irreducible i?-stable divisor of X which contains a G-orbit is G-stable. 

Lemma 2.1 Let G/H he a spherical homogeneous space (not necessarily of minimal rank). 
Let (X, x) he a toroidal embedding of G/H and y he a point in X. 
Then, we have the inequality: 

Tk{G/H) + Tk{H) > rk(G.y) + rk(G^). 

In particular, if G/H is of minimal rank, G.y is. 
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Proof. Firstly, we prove that it is sufficient to show the lemma when dim{G.y) = dim(X) — 
1. By jBL87l Lemma 2.1.1], since X is toroidal, there exists G-orbits Oq, ■ ■ ■ ,Os such 
that G.y = Oq C Oi C ■ ■ ■ C Os = X (where Oi denotes the closure of Oi in X) and 
dim((9j4.i) = dim(Cj) + 1 for alH = 0, ■ ■ ■ , s — 1. For all z we fix a point yi in Oi. Since Oi 
is normal, we can apply the case when dim{G.y) = dim(X) — 1 to each Oi C Cj+i showing 
that: 

rk(G'.y,+i) + iHGy^^J > Tk{G.y,) + rk(G,J. 
The inequality of the lemma follows. 

We now assume that dim{G.y) = dim(X) — 1. Set O = G.y. Consider the linear action 
of the group Gy acts on quotient TyX/TyO of TyX by TyO. Since X is normal, it is smooth 
at y and TyX/TyO is a line. So, the action of Gy defines a character x '■ Gy — > K*. 

Let Ty be a maximal torus of Gy. Let S denote the neutral component of the kernel of 
the restriction of x to Ty. We claim that S has fixed points in G.x. Set Q = G.x U (9; it 
is open in X and hence it is a smooth variety. By a result of Bialynicki-Birula, we have 
Tx{^^) = (T^Q)^ . In particular, is not contained in O. This proves the claim. 

By the claim, a subgroup conjugated to S fixes x and: 

Tk{H) > dim(5) = dim{Ty) - 1 = rk(G'.J - 1. 

Moreover, since X is toroidal ik{G/H) = rk((9) + 1. The lemma follows. □ 

2.2.2 — The fixed points of a maximal torus of G in the toroidal embeddings of spherical 
homogeneous spaces of minimal rank are easy to localize. Indeed, we have: 

Proposition 2.4 Let {G, H) be a spherical pair and T be a maximal torus of G. The 
following are equivalent: 

(i) {G,H) is of minimal rank. 

(a) There exists a complete toroidal embedding {X,x) of G/H such that for all x G 
G.x is complete. 

(Hi) For all complete toroidal embedding {X,x) of G/H and for allx G X'^ , G.x is complete. 

Proof. We assume that {G, H) is of minimal rank and fix a complete toroidal embedding 
(X, of G/H. Let y G X"^ . Lemma ITT] shows that Tk{G.y) = 0; that is G.y is complete. 



This proves that Assertion (i) implies Assertion (iii 



Conversely, let (X, x) satisfying Assertion (ii) It remains to prove that (G, H) is of 
minimal rank. 

Let A be a one-parameter subgroup of T such that T is the centralizer of the image of 
A (that is, A is regular) and X'^ = X^ (where X'^ denote the set of fix points of the image 
of A). Since A is regular, the set G G such that \im.t^Q\{t)g\{t~^) exists in G is a Borel 
subgroup of G denoted by -B(A). By Proposition 12. H it is sufficient to prove that for all 
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y G G.x we have ik{B{X).y) = ik{G/H). This holds by Lemma [2.21 below since the rank of 
a complete G-orbit equals zero. □ 



Lemma 2.2 Let (X, x) he a complete toroidal embedding of the spherical homogeneous space 
G/ H . Let y he a point in the open G -orbit in X Let X be a regular one-parameter subgroup 
ofT such that = X^ . Set z = lim^^o Mt)y. 
Then, we have: 

rk{G/H) - ik{B{\).y) = rk{G.z). 

Proof. Let us introduce some material and notation from |BL87j . There exists a parabolic 
subgroup P of G containing T such that is reductive. Let Q denote the parabolic subgroup 
of G containing T and opposite to P. We have G^ C and there exists a closed subvariety 
A C Pj-stable such that the product in G induces an isomorphism A x — > Q". By 
[BL87t Lemma 1.1], there exists a locally closed affine normal and irreducible subvariety S 
of X such that S H G.z = {z}, S is Pj-stable and the morphism G x S — > X induced by 
the action is smooth at (1,-2). In particular, we have: 

dim(5) = dim{G/H) - dim(G.z) = ik{G/H) - rk(G.z). (1) 

Let P Xp_^{Ax S) denote the quotient of P x A x by the action of P^ defined by p. (g, a, s) = 
{qp~^ , pap~^ , ps) , where p G Pz, {q,a,s) E P x A x S. The group P acts naturally on this 
variety. By |BL87i Theorem 5], the morphism 

e : Pxp^{Ax S) — > X 

{p:{a,s)) I — > {pa).s 

is an open immersion. 

Consider the Bialynicki-Birula cell 

X{X,z) = {pe X : \imX{t)p = z}. 

Notice that y G X{X,z). By |BL87l Propositions 2.1 and 2.3], X{X,z) n G.x = B{X).y and 
G.x n 5* = T.y' for some y' G B{X).y. Then, the proof of |BL87i Proposition 2.3] shows that 
B induces by restriction an isomorphism: 

(P n P(A)) Xb(,)^ ((A n P(A)) X T.y') B{X).y. 

Since T is contained in B{X)z, this isomorphism implies that 

Tk{B{X).y) = dim{T.y') = dimS. (2) 
The lemma follows from Equalities [1] and [2l □ 
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3 Reduction to the case when G and H are semi-simple 



The goal of this section is to reduce the classification of the spherical pairs (G, H) to 
those with G semi-simple adjoint and H semi-simple. 

Proposition 3.1 Let {G, H) be a spherical pair of minimal rank. 

Then, there exists a parabolic subgroup P of G with a Levi decomposition P = P^L and 
a reductive subgroup K of L such that: 

(i) H = P'^K 

(a) {L, K) is a spherical pair of minimal rank. 

Proof. We can write H = H^K, where is a reductive subgroup of H. But, by 
[Humphreys, 30.3], there exists a parabolic subgroup P = P^L of G such that if" C and 
K 'O L. We claim that P and L satisfy the proposition. 

Let firstly prove that P" = if". 

Let T{H) be a maximal torus of K (and hence of if). The variety B contains on open 
subset stable by P (and hence by H) isomorphic to P" x B{L) (with obvious notation). By 
assumption, there exists a point x in B fixed by T{H) such that H.x is open in B. But, 
X = {u,y) belongs to P" x B{L). Since the ii-orbit of x is open in P" x B{L), so is its 
intersection with P" x {y}. Hence, the set of the hkuk~^ G P" such that h G ii" and k G Ky 
is open and dense in P". In particular, the i^y-orbit Ky.{uH^) is open and dense in P^/H^. 

Since x G B^^^\ uH"" G (P"/if")^(^). But, Ky is a solvable group with T{H) as maximal 
torus. So, Ky.uH^ is one orbit of the unipotent radical Ky of K°. In particular, it is closed 
in the affine variety P'^/H'^. But it is also open. We deduce that Ky acts transitively on 
P"/ii". 

But Ky is contained is K and normalizes ii". So, if" is a fix point of Ky in P^ / H^. We 
deduce that P'^/H^ has only one point ; that is, that P" = if". 

On the other hand, K.y is open in B{L) and y is fixed by the maximal torus T{H) of K. 
We deduce that (P, K) is a spherical pair of minimal rank. □ 

Since the parabolic subgroups of a given reductive group are very well known. Proposi- 
tion 13.11 reduces the problem of classification of the spherical pairs (G, H) of minimal rank 
to the case when H is reductive. 

Proposition 3.2 Let G be a connected reductive group. Set Gad = G/Z{G) and consider 
the projection p : G — > Gad- Let H be a reductive subgroup of G. Then, 

(i) The pair (G, H) is spherical of minimal rank if and only if the pair {Gs,d,p{H)) is. 

(a) The pair (G, H) is spherical of minimal rank if and only if the pair (G, H°) is. 



9 



(in) IfG/H is of minimal rank, the neutral component p{H)° of p{H) is semi-simple. 



Proof. Assertions (i) and 



of Proposition 12.11 



are obvious from Assertion 
To prove the last assertion, it is sufficient to prove that the connected center S* of if is 
contained in the center of G. There exists x E B fixed by S such that H.x is open in B. 
Since, H C G''^ , G^ .x is open in B. But, G'^ .x is an irreducible component of B^ . Therefore, 
B^ = B and 5* is central in G. □ 



Proposition 13.21 reduces the problem of classification of the spherical pairs (G, H) of 
minimal rank to the case when G is semi-simple adjoint and H is semi-simple. From now 
on, we only consider such pairs. 



4 Classification of Lie algebras 

Let {G, H) be a spherical pair of minimal rank with G semi-simple adjoint and H semi- 
simple. Let g (resp. f)) denote the Lie algebra of G (resp. H). 



4.1 Root systems of g and [) 

Let T{H) be a maximal torus of H. Let T D T{H) be a maximal torus of G. Let 
X{T) = Hom(T,K*) (resp. X{T{H)) = Hom(T(if), K*)) denote the character group of T 
(resp. T{H)). Let 0^ C X{T) (resp. 0f, C X{T{H))) be the set of roots of q (resp. f)). Let 
p : X{T) — > X(T{H)) be the restriction map. 

In this subsection, we will prove some very constraining relations between 0g, 0(, and p. 



4.1.1 

The following stability of the set spherical pairs of minimal rank will be used to localize 
the study over some fixed roots of f): 



Lemma 4.1 Let S be a suhtorus of H. 

Then, {G^ , H^) is a spherical pair of minimal rank. 

Proof. Let T{H) be a maximal torus of H which contains 5*. Let a; be a fixed point of 
T{H) in B such that H.x is open in B. Since V fl G^ .x is open in G^ .x, it is irreducible. 
So, it is an irreducible component of . Now, [i Ric82] implies that V fl G'^.x = H^.x. In 
particular, H^.x is open in G^ .x ~ B{G^) and x is fixed by the maximal torus T{H) of H^. 
The lemma follows. □ 



Lemma 4.2 With the above notation, we have p{(Pq) = 4>t). 



10 



Proof. Let a e ^g. Set S = Ker(p(a))° C T{H). By Lemma El is a spherical 
subgroup of and Yk{G^ /H^) = rk(G''^) — Tk{H^). Since the semi-simple rank of is 
one, this implies that is not a torus. So, p{a) is a root of f}. 

Moreover, since () C g, (^p, C p(0g). □ 

By Lemma we can define the map p^f, : (pg — > </)[,, a i — > p{c(). 

Lemma 4.3 The spherical pairs {G, H) of minimal rank with G semi-simple adjoint, H 
connected and f) = are: 

(i) (PSL2,PSL2). 

(a) PSL2 diagonally embedded in PSL2 x PSL2. 



Proof. By Assertion (i) of Proposition 12.11 the dimension of B is at most 2. We deduce 
that G = PSL2 or PSL2 x PSL2. The lemma follows easily. □ 



Lemma 4.4 Let a E (j)^. 

Then, p'^'^^a) contains either one root of g or two orthogonal roots of Q. Moreover, if 
p^^(a) = {a°} then [)a = Qa° ; md if p^^{a) = {a;~,a+} with a" ^ E (f)g then i)^ 7^ 0a±. 

Proof. Set S = ker(Q;)°. Since f)'^ ~ sl2 and by Lemma [4.11 we can apply Lemma [4.31 to 
{G^ /S,H^ /S). The lemma follows immediately. □ 

Lemma 14.41 divides the set of roots of f) in two kinds: 

(pl := {a e (f)u : |p^^(a)| = 1} and 0^ |^ ^ . |p-i((^)| = 2}. 

We denote by Wh the Weyl group Nh{T{H))/T{H) of H. 

Lemma 4.5 The sets 0^ and 0^ are stable by the action ofWu- 

Proof. By Lemma[4ll (G'^(^),T(/f)) is a spherical pair of minimal rank. So, G^^^^ is a 
torus and G^^^^ = T. In particular, Nh{T{H)) is contained in NciT); this inclusion induces 
an injection of Wh = Nh{T{H)) /T{H) into W = Ng{T)/T. By this injection, we obtain an 
action of Wh on X{T) such that p is PV/z-equivariant. The lemma follows. □ 

4.1.2 Simple roots 

In Section [4.1.11 we just proved that p induces a map from 0[, onto 0[,. In this section, 
we will prove that p induces a map from the Dynkin diagram of g onto those of f). 

Let us fix a choice 0jj" of positive roots for f). Set 0g = P0^(0^). Let Ag (resp. Af,) be 
the set of simple roots of 0g (resp. (ptj). 
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Lemma 4.6 Let a be a root of g. Then, a G Ag if and only if Ptf,{oL) G A(,. 
Proof. Since a G 0^ if and only if p(a) G 0(J", we may assume that a G 0^. 

Let us assume that a ^ Ag. Then, there exists j3 and 7 in 0g such that a = /? + 7. By 
applying p, we see that p{a) does not lie in A[j. 

Let us assume that a G Ag. By absurd, we assume that there exists (3 and 7 in cf)'^ such 
that = + 7. Three cases occurs: 
Case 1 : [3 and 7 belong to 0^. 

Let /5° and 7° be in 0g such that p{[3°) = (3 and p(7°) = 7. By Lemma I^l3| g/30 = and 

= f)^. So, we have: 

[0/3°, 07°] = [f3/3, (^7] = f)p(a)- 

In particular this bracket is non zero and /9° + 7° is a root of q. Moreover, 0/3°+-^° = f)p(a). So, 
Lemma H73l shows that p(a) G But a and /3° + 7° belong to p^^(p(a)). So, a = /5° + 7°; 
and this root is not simple. 
Case 2 : P E 4>l and 7 G 0^. 

Let /3° as above. We can write p'^^ij) = {7"*", 7~}. We have: 

0/3°+7+ + 0/3°+7- 3 [0/3°, 07+ +07-] ^ [0/3°, ^^7] = [^/3' ^7] = = f)p{")- 

Moreover, since f)^ is different from and g^-, P)p(Q) is different from and g^o.,.^-. 

In particular, (3° + 7+ and P° + 7" are roots of g; and p^^(p(a)) = {P° + 7^, + 7~}. So, 
a = /3° + 7"*" or /5° + 7~; and this root is not simple. 
Case 3 : /? and 7 belong to 0^. 

With obvious notation, we have: 

0/3+ +7+ + 0/3++7- + 0/3-+7+ + 0/3-+7- ^ [1^/3, 1^7] = f)/3+7- 

If f)/3+^ equals one of the four spaces g/3±+^±. Lemma shows that a equals + 7^ 
and is not a simple root. Else, two of the four spaces g/3±+^± are not zero and a equals one 
of the two corresponding roots; in particular a is not simple. □ 

Consider the map 

PA : Ag > A(, 

tt I — ^ P0(")- 

Set A^ = A(, n (f)l and Aj = A,, n 

On the Dynkin diagram of f), we color in black the simple roots in A^f). The so obtained 
diagram is called the colored Dynkin diagram of f) and is denoted by V^. From now on, 
when we draw the Dynkin diagram Dg of g, two simple roots a and (3 are placed on the 
same vertical line if and only if pA(tt) = Pa(/5); in such a way, pa identifies with the vertical 
projection. Note that by Lemma [4.41 a and f3 are orthogonal. For (PSL4,PSp4), we obtain 
the following picture: 
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• < o 

By exchanging the simple roots in a fiber of pa? we define an involution cTfj on the set of 
vertices of the Dynkin diagram of g. 

4.2 A result of unicity 

Proposition 4.1 For a fixed pair (Pg, df,) there exists at most one (up to conjugacy by an 
element of G) spherical pair {G, H) where G is adjoint and H connected. 

Proof. Obviously, G is determined by Vg. Let us fix a Borel subgroup B of G and a 
maximal torus T of B. Let Ag denote the set of simple roots of G. For any a G Ag, we fix 
a s[2-triple (Xq,, Fq, Consider 

e : T — > (K*)^^ 

t ^ mMt-')) ^ ^ f3 ^ . 

pA{a) = pAiP) 

The neutral component S of the kernel of is a subtorus of T of dimension | Ag | — | A^ | = | A[j | . 
Moreover, B is surjective. 

Let if be a semi-simple subgroup of G such that (G, H) is a spherical pair of minimal 
rank with (Dg,D[,,pA) as associated triple. Let T{H) be a maximal torus of G. Up to 
conjugacy, we may assume that T{H) is contained in T. But, T{H) is contained in S; by an 
argument of dimension, we conclude that T{H) = S. 

For all a G Ag, we have Qa = i)p{a)- Moreover, we claim that up to conjugacy, we may 
assume that for all a 7^ /9 G Ag such that pA(a) = Pa{P) we have i)p{a) = IK.(Xa + X^). 

We write A^ = {ai, ■ ■ ■ , a^} and A^ = {af , ■ ■ ■ , a^} U {af, ■ ■ ■ , a^} such that for all 
i = 1, ■ ■ ■ , /c, p{af) = oti- By Lemma 14. 4[ there exist (xi, ■ ■ ■ , Xk) G K* such that for all 
i = 1, ■ ■ ■ , fc, i)ai = K.{X - + XiX +). Since 9 is surjective, there exists t E T such that 

i i 

&{t) = {xi, - ■ ■ , Xk). By conjugating H by t, we obtain the claim. 

Let 2 G {1, ■ ■ ■ , k}. There exists y eK* such that = K.(Y - + yY +). Since a~ and 

i i 

af are orthogonal, ^ := [X ~ + X +,Y - + yY" +] = H - + yH +. But, ^ belongs to the Lie 

ill i i i 

algebra of T{H), that is to S, so {a^ — af){^) = 0. We conclude that y = I. 

Finally, since f) is generated as Lie algebra by the for a G Af,; f) is generated by: 

{XJ,,AJ U {Ya}aeAl U {X^- + X,+ }a6A^ U + Y;+}.eA^ 

In particular, t) only depends on the triple (Vg, CTf,). □ 
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4.2.1 The case when Tk{H) = 2 

Lemma 113] considers the case when rk(i/) = 1. We now consider the case when rk(if) = 

2: 

Lemma 4.7 We assume that Tk{H) = 2. Then, the possibilities for (Dg, cTfj) are: 
(i) ("Di,, Identity) obtained with G = H . 

(a) ("Df, U Pf,, Exchange) obtained with H embedded diagonally in H x H. 

(Hi) T>g = and fixes the central vertex and exchanges the two others; obtained with 
H = PSp4 CG = FSU: 




(iv) Vg = and fixes the central vertex and exchanges the two others; obtained with 
G2 C SOr.- 




Proof. If 0^ is empty, the dimensions of q and f) are equal and hence = f). From now on, 
we assume that 0^ is not empty. Since 0^ is stable by the action of the Weyl group Wh of 
H, is non empty. 

By invariance by Wh the possibilities for colored Dynkin diagrams of f) are: 

• • • O • • • > • • > O 

O > • • > • O > • • > O 

In each case, using the action of Wh, one can determine 0j and 0^ and thus, compute 
the cardinality |0g| of 0g which equals |0^| + 2|0^|. Moreover, by Lemma [4.31 the two simple 
roots of Q which map on a simple root of 0^ are orthogonal. These constraints imply a small 
number of possibilities for (Vg,V^, p^^). In the following tabular, we list these possibilities 
omitting those corresponding to f) C f) x f) and SI2 x sl2 — ^ 5I2 x x sl2, ^ {^:^:V)- 
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Case 


[) 


Colored 
Dynkin diagram 
of [) 


(101,1,10^,1) 


I0J 


Dynkin diagram 
of g 


s 


1 






(0,6) 


12 


o =o 


Sp4 X S[2 X 512 


• • 


O O 


2 






(0,8) 


16 




Sp4 X Sp4 


• • 




3 


Sp4 


• > o 


(4,4) 


12 




3(4 


4 




• < o 


(4,4) 


12 




S[4 


5 


^2 




(0, 12) 


24 


a < o 
o ^ 




• • 




6 


G2 


• > 


(6,6) 


18 




SO7 


7 


G2 


• 'C 


(6,6) 


18 


> 


SO7 



There is no nontrivial action of the group PSL3 on P^. But in Case 1, is a factor of 
B] and H cannot have a dense orbit in B. In Case 2, the projections of t) on each factor of 
g are isomorphisms: Case 2 also cannot occur. 

Consider Case 3. Let a (resp. (S) denote the short (resp. long) simple root of \). Set 
a° = p~^{(y) and (a + (3)° = p~^{a). By Lemma H75l a + (3 E (j)]^. So, 

^2a+P = f)a+/3] = [0a° , 0{a+/3)°] = 0Q° + (a+/3)°- 
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Now, Lemma [4.41 shows that 2a + /5 G 0^. With Lemma [4. 5[ this contradicts j3 G 0^. 
By ehmination, the inclusion of PSp4 in PSL4 corresponds to Case 4. 
Consider Case 5. We label the simple roots of q and P) as follows: 



O «4 




am 9P 

We have p^a^ + 04) = p{a2 + ai) = p(a2 + c^s) + but ^3 + 04, 0:2 + ai and 0:2 + 03 
are three distinct roots of g. This contradicts Lemma [4.41 

Consider Case 6. Let a (resp. /?) denote the short (resp. long) simple root of f). By 
Lemma [4. 5[ (3 + 2a belongs to By the argument used in Case 3 before, one easily checks 
that P + 3a = {P + 2a) + a belongs to This contradicts Lemma I4.5[ since + Sa is a 
long root. 

Case 7 corresponds to the inclusion of G2 in SO7. □ 
We may now assume that H is simple. Indeed, we have: 

Proposition 4.2 Let {G, H) be a spherical pair of minimal rank with G semi-simple adjoint 
and H connected. If H is not simple then there exists two spherical pairs {Gi,Hi) and 
{G2, H2) of minimal rank such that G = Gi x G2 and H = Hi x H2. 

Proof. By assumption, Pf, is the disjoint union of two Dynkin diagrams Vi and V2. By 
Lemmas l4.7l and l4.H for all a, /5 G Ag such that p{a) and p{j3) are orthogonal, a and (3 are 
orthogonal. We deduce that Vg is the disjoint union of pl\Vi) and pl\V2). The proposi- 
tion follows. □ 

By Proposition 14.21 to classify all the spherical pairs {G, H) of minimal rank with G 
simple-simple adjoint and H semi-simple, we may assume that H is simple. The Theorem 1X1 
stated in the introduction lists all such spherical pairs. We can now prove this classification. 

Proof, [of Theorem lA] By Proposition 14. it is sufficient to classify the possible triples 
(Dg,D[,,PA)- By Lemma [4.7[ we may assume that rk(iJ) > 3. Moreover, we may assume 
that is non empty and different from Aj,. Let a G A^ and (3 G Aj. By Lemma [4.71 either 
a and (3 are orthogonal or a is the short root joined to the long root /5 by a double edge. 
One easily deduces that the colored Dynkin diagram of f) is one of the following: 

• • • • < O 

O O O O • 

O O • • 
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One easily deduces from Lemmas 14 . 1 1 and |4. 71 than in the three preceding case the Dynkin 
diagram is respectively: 




The theorem follows. □ 
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